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1, INTRODUCTION 

Nowadays, multimedia applications are widely used as an effective information because it is formed by 
combining various kinds of datas ie. text, images, sound, video, and animation so that the information becomes 
clearer. Multimedia information, such as voice calls and video calls can perform remotely. This is due to 
the presence of digital signal processing that has modular capabilities with IP-based network that integrate 
data and voice communication. The software defined networks is a platform to reduce the complexity 
of network elements [1]. The essential ideas of SDN are the decoupling of the data plane and control plane 
from networks and centralized control and management of the forwarding traffic in large-scale networks [2]. 
The advantage of SDN is to reduce the management and maintenance costs by using the SDN controller to 
configure the traffic forwarding rules of SDN-enable switches dynamically in SDN [3, 4]. The OpenFlow 
protocol defines the communication standard in SDN environments [5-7]. Research on SDN performance 
with various scenarios of routing protocols or types of services has been carried out such as using the OSPF 
routing protocol [8-11], BGP protocol [12-14], or RIP Protocol using SDN [15-17]. The most research 
of SDN is usually done by simulations using simulator. 

In this paper, we implemented multimedia services in the form of voice and video calls on SDN by 
using four switches as interconnected data planes and PC as control plane. The PC aims to control 
the network. We applied three routing protocols in the network, such as BGP, OSPF, and RIP. We used POX 
as a controller and Trixbox as a server. QoS service test on multimedia applications are performed to 
determine the best routing protocol. 
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2. RESEARCH METHOD 
2.1. Software defined network 

SDN is a concept of a computer network architecture approach that controls a separate system from 
the hardware. In general, the current network architecture is a control system that determines the decision 
of the flow of data sent is still in the same device. In SDN a centralized network in a software-based 
controller can maintain the overall network so that it can simplify designing and operate the network because 
only through a logical point. SDN has three layers such as infrastructure layer (network device), control layer 
(network service) and the third is application layer [18]. The three layers have different functions, as in Figure 1. 
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Figure 1. SDN architecture 


2.2. Routing protocol 

In this study, we compare the performance between interior routing protocols on SDN. We also 
tested exterior routing protocols with the same parameters to see the effects on the SDN. Interior routing 
protocols are OSPF and RIP and the exterior routing protocol is BGP. The selection of routing protocols 
is based on three types of algorithms, e.g. link state (for example OSPF), distance vectors (for example RIP), 
and path vectors (for example BGP). The BGP protocol delivers information packages between aoutonomous 
system (AS) [19]. AS is a set of routers that it is in the same administration with the same interior gateway 
protocol (IGP). The BGP is documented in RFC number 4271 [20]. OSPF is part of the IGP group that uses 
the Link-State protocol and the Dyikstra algorithm which is more efficient than other IGP protocols [21]. 
In determining the best path, OSPF uses the smallest cost metric, namely the weighting of paths based on 
current conditions. The OSPF version 3 supports Ipv6 [22]. 

RIP is a distance-vector protocol that determining the best route by the number of hops. RIP has 
a simpler level of complexity, so that resource and memory consumption are also low. RIP is used 
on a small-scale network, with a few of hosts. RIPng (RIP next generation) is defined in RFC 2080, 
which is a RIPv2 development and IPv6 supporter [23]. 


2.3. Quality of services 

In the process of analyzing SDN performance, several parameters will use in QoS measurements. 
Following is the Table 1, is the QoS value standard for multimedia services, there are voice call and video 
call on IP networks based on standard ITU-T G.1010. 


Table 1. QoS value standard [24] 
Multimedia service parameter 


Medium Delay Jitter Packet loss 
Voice call <150 ms-<400 ms <1l ms <3% 
Video call <150 ms-<400 ms N/A <1% 
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2.4. Mean opinion score 

Mean opinion score is a standard used to determine service quality based on user experience. 
The standard is divided into five levels called absolute category ranking (ACR) scale, which ranges 
from 1 to 5 [25]. The levels of the absolute category ranking are as in Figure 2. However, MOS 
measurements cannot be done in real-time. The objective measurement method proposed by Rec. ITU-T 
G.107 is called the E-model. It takes into account all interference factors that increase or decrease sound 
quality in one metric called the R-factor. R-factor is the measurement result of the E-model which 
is equivalent with MOS. The following formulas (1-5) are for obtaining MOS [26, 27]. 


R=94.2 — la— Ter (1) 


Where J/g is a factor in the decrease in sound quality by a delay, Jr is a factor in quality loss due to 
compression and packet loss techniques. 


1,=0.024 x d + 0.11 x (d-177.3) x H(d-177.3) (2) 
Iy=7 + 30xIn (1 + 15e) (3) 


R is the value of delivery quality factor, d is the delay value and H is the heavy side function and e 
is a percentage of packet loss occurs. 


0,ifx < 0 
Hoo 1ifx > 0 © 


Correlation between R-factor and ACR MOS, can be seen in (5) [28]. 
1,ifR <0 
MOS= 4.5,if R > 100 (5) 
1 + 0.035R +R(R- 60)(100 - R)7x10°°,if0 <R < 100 
The R-factor refers to the MOS standard. The correlation among R-factor, ACR MOS and user 


satisfaction can be seen in Figure 2. Correlation is used to determine how good the quality of service 
produced is based on the level of user satisfaction. 


Absolute Category Ranking R-Factor MOS 
(ACR) MOS 





Figure 2. Correlation among R-factor, ACR MOS and user satisfaction 


3. SYSTEM MODEL 
3.1. Network topology design 

The network topology design in this paper uses four computer, four switches and one conventional 
switch as a link as in Figure 3. The network topology consists of 4 hosts, 4 Open Vswitch (OVS) and 
1 controller. Especially for the BGP protocol testing scenario, each PC is in a different AS. For software 
specifications (OS, simulator and Virtual Machine) and hardware (Computer user, Computer as controller, 
Switch) used can be seen in Table 2. The software design used RouteFlow which is installed on Ubuntu 
Operating system that runs on a virtual machine (VM) using VMware. This RouteFlow has the capability 
of routing and switch control functions. 
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Figure 3. Network topology design 


Table 2. Device specification 


Component Specification 
Computer as a controller Intel(R) Core(TM) 13 CPU 400SU @ 1.7 GHz, RAM 6 GB, 
Operating system (OS) Ubuntu 12.04 LTS 64 bit (RouteFlow) & Ubuntu 12.10 
Quantal 64 bit (Mininet) 
Forwarding plane 5 Switch TP-Link WR1043ND v2, Frequency 2.4-2.4835Ghz 
Virtual machine 2 Vmware 
Emulator Mininet 
Controller POX controller on RouteFlow 
Routing engine Quagga 


3.2. Design of control system 
In the design of the control system the stage that carried out to design and make control SDN-based 
network. This RouteFlow installs on VM with Ubuntu operating system which has the ability to control 
routing functions. Process installation RouteFlow is to install POX controller, quagga, and supporting 
components of RouteFlow itself. The configuration stage on RouteFlow is in accordance with the network 
topology that has been designed before. There are also rfvm folders and files in the rftest folder that support 
RouteFlow environment. The following is an explanation for some of these files. 
— rftest 
rftest is a system configuration RouteFlow that integrates the components and files provided on 
the RouteFlow Environment that is used to run RouteFlow. 
— rftest2config.csv 
In the rftest2config.csv the implementation of configuration dp_id and dp_port on RouteFlow must be 
the same as the configurations datapath-id and Open vSwitch port on the OVS switch. 
— daemons 
The functions of the file daemons are to the enable routing protocol to be used. This research use routing 
protocols BGP, OSPF, and RIP, so it is activated bgpd, ospfd, and ripd. 


3.3. Design of forwarding 

Design of forwarding step is the steps taken to design and create a routing system of SDN-based 
network. The design was divided into two steps, there are installation OpenWrt and Open vSwitch 
and configuration port, the network topology using TP-Link WR1043ND wireless router. The device is 
installed with OpenWrt and Open vSwitch. OpenWrt used is OpenWrt version 15.05 Chaos Calmer which 
was built by compiling and implementing Open vSwitch version 2.3.90. Port Configuration on device 
forwarding is done by setting ports that 1s connected to controller, port configuration, and data plane port. 


3.4. Design of multimedia service 

In this stage is carried out to create a multimedia service used to connect between clients by 
installing Trixbox services on VM with the Linux operating system in Ubuntu version. As shown in Figure 4 
We used IOS Trixbox version 2.8.0.4 and X-Lite version 5.5.0 is used for client communication. 
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Figure 4. GUI of X-lite and Trixbox software 


4. RESULTS AND DISCUSSION 
4.1. Performance measurement 

Performance measurement are implemented using several routing protocols such as BGP, OSPF, 
and RIP for multimedia services, there are voice call and video call using Wireshark. This test is carried out 
on PC 1 to PC 4 which is interconnected and can be assessed using several routing protocols with server-side 
(PC 1) on sender and client-side (PC 2) on the recipient. The measurements were carried out 10 times with each 
observation for 60 seconds. The parameters chosen are throughput, delay, jitter, convergence time and MOS. 


4.2. Comparison of QoS results 

The results QoS measurements on multimedia services were carried out, there are voice call and 
video call with background traffic in client side 10 Mbps, 30 Mbps, 50 Mbps, and 90 Mbps. The aims is to 
determine the server performance limits on traffic loads. 


4.2.1. Throughput 

Based on the test results, throughput carried out for 60 seconds, so the measurements results as in 
Figure 5, the difference in throughput value at each given traffic load. The average measurements obtained of 
voice call on routing BGP with background traffic 10 Mbps is 59.8 Kbps, 30 Mbps is 55.9 Kbps, 50 Mbps is 
42.3 Kbps, and 90 Mbps is 6.7 Kbps, routing OSPF with background traffic 10 Mbps is 60.7 Kbps, 30 Mbps 
is 57.7 Kbps, 50 Mbps is 43.8 Kbps, and 90 Mbps is 8.7 Kbps, and routing RIP with background traffic 
10 Mbps is 58.8 Kbps, 30 Mbps is 54.6 Kbps, 50 Mbps is 41.8 Kbps, and 90 Mbps is 5.2 Kbps. 
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Figure 5. Throughput with background traffic of (a) voice call, (b) video call 


In Figure 5, the average measurement throughput of video call on routing BGP with background 
traffic 10 Mbps is 214.7 Kbps, 30 Mbps is 196.4 Kbps, 50 Mbps is 143.9 Kbps, and 90 Mbps is 102.7 Kbps, 
routing OSPF with background traffic 10 Mbps is 265.5 Kbps, 30 Mbps is 243.5 Kbps, 50 Mbps is 
198.9 Kbps, and 90 Mbps is 165.8 Kbps, and routing RIP with background traffic 10 Mbps is 147.7 Kbps, 
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30 Mbps is 128.8 Kbps, 50 Mbps is 97.6 Kbps, and 90Mbps is 64.9 Kbps. In Figure 5, if traffic load is given 
large, value throughput will be smaller. This happen because heavy traffic so the available bandwidth is also 
getting denser and the number of bits sent every second decreases. 


4.2.2. Delay 

Based on testing that has been done for 60 seconds, the results average delay of voice call can be 
seen as in Figure 5 on routing BGP with background traffic 10 Mbps is 19.565 ms, 30 Mbps is 20.060 ms, 
50 Mbps is 21.065 ms, and 90 Mbps is 21.474 ms, routing OSPF with background traffic 10 Mbps is 19.438 
ms, 30 Mbps is 19.754 ms, 50 Mbps is 20.389 ms, and 90 Mbps is 21.094 ms, and routing RIP with 
background traffic 10 Mbps is 19.780 ms, 30 Mbps is 20.438 ms, 50 Mbps is 21.205 ms, and 90 Mbps is 
22.037 ms. In Figure 6, the average measurements delay of video call on routing BGP with background 
traffic 10 Mbps is 19.9981 ms, 30 Mbps is 20.230 ms, 50 Mbps is 21.247 ms, and 90 Mbps is 22.342 ms, 
routing OSPF with background traffic 10 Mbps is 19.565 ms, 30 Mbps is 19.874 ms, 50 Mbps is 21.237 ms, 
and 90 Mbps is 22.858 ms, and routing RIP with background traffic 10 Mbps is 20.081 ms, 30 Mbps is 
22.497 ms, and 50 Mbps is 24.154 ms, and 90 Mbps is 25.172 ms. 
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Figure 6. The delay with background traffic of (a) Voice call, (b) Video call 
4.2.3. Jitter 


Based on testing carried out for 60 seconds, the average measurements of voice call can be seen in 
Figure 7, on routing BGP with background traffic is 0.254 ms, 30 Mbps is 0.340 ms, 50 Mbps is 0.382 ms, 
and 90 Mbps is 0.437 ms, routing OSPF with background traffic 10 Mbps is 0.224 ms, 30 Mbps 1s 0.254 ms, 
50 Mbps is 0.315 ms, and 90 Mbps is 0.431 ms, and routing RIP with background traffic 10 Mbps is 0.437 
ms, 30 Mbps is 0.689 ms, and 50 Mbps is 0.744 ms, and 90 Mbps is 0.753 ms. In Figure 7, the average 
measurement jitter of video call on routing BGP with background traffic 10 Mbps is 0.529 ms, 30 Mbps is 
0.603 ms, 50 Mbps is 0.382 ms, and 90 Mbps is 0.437 ms, routing OSPF with background traffic 10 Mbps is 
0.312 ms, 30 Mbps is 0.365 ms, 50 Mbps is 0.545 ms, and 90 Mbps is 0.786 ms, and routing BGP 10 Mbps is 
0.884 ms, 30 Mbps is 0.955 ms, 50 Mbps is 1.062 ms, and 90 Mbps is 1.254 ms. In Figure 7 can be seen 
increasing the traffic background, then the variation on delay (jitter) is also getting bigger. The higher 
the background traffic, the greater the utility of the link which causes the jitter value to vary and be unstable. 
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Figure 7. The jitter with background traffic of (a) voice call, (b) video call 
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4.2.4. Convergence time 

The convergence time measurement aims, to determine time needed by the router to reach the state 
of convergence. The following graph convergence time on SDN-based computer networks of simulation 
and implementation methods by performing 10 times the experiment. In Figure 8, it can be concluded that 
convergence time of simulation and implementation is not much different. The convergence time results of 
simulation with routing BGP is 11.3 s, routing OSPF is 4.1 s, and routing RIP is 14.9 s. The implementation 
with routing BGP is 13.1 s, routing OSPF is 4.3 s, and routing RIP is 15.1 s. The less convergence time, 
the better the network. 
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Figure 8. The time convergence time 


4.2.5. MOS 

MOS measurements are carried out within 60 seconds. MOS values are determined based on (1)-(5). 
The average MOS on voice call with routing BGP is 4.08, OSPF is 4.13, and RIP is 4.01. And the average 
MOS on video call with routing BGP is 4.05, OSPF, 4.11, and RIP is 4.02. At Figure 9 can be concluded 
the average value MOS on video call and voice call are called Good quality. 
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Figure 9. MOS average value of voice call and video call 


5. CONCLUSION 

In this study, we successfully applied the SDN concept to separate the control plane and the data 
plane on conventional network devices. We implement the control plane and data plane on the switch using 
open Vswitch and route flow. SDN networks that are built can serve multimedia applications well. 
Test results between the OSPF and RIP protocols for voice and video call services based on parameters 
throughput, delay, jitter, convergence time and MOS show that OSPF produces the best performance. 
Testing on the BGP protocol with its exterior characteristics has the same impact as other protocols, 
the greater the background traffic, the lower the output. The effect of adding background traffic from 
10 Mbps to 90 Mbps reduces the QoS value, although it is still in a good category based on Rec. ITU-T 
G.1010, G.107, and P.910. 
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